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Description 

TECHNICAL FIELD 

[0001] The present Invention relates to an apparatus s 
for performing medical procedures in the thorax of a 
medical or veterinary patient. 

BACKGROUND ART 

[0002] Some common medical procedures require 
the ability to operate on a specific location in the thorax, 
Including locations in the respiratory system, such as the 
lungs, bronchi and immediately surrounding tissues. For 
example, needle aspiration biopsies have been per- 
fonmed heretofore using an endoscope inserted through 
the trachea into a bronchus. The needle is advanced 
through the endoscope through the bronchial wall to 
sample tissue in a lymph node within the lung parenchy- 
ma near the exterior surface of the bronchus. The phy- 
sician can monitor placement of the endoscope and the 
biopsy needle using the optical system of the endo- 
scope. As the endoscope is advanced toward the area 
to be sampled, the physician can determine where the 
tip of the endoscope lies by observing features of the 
airway itself. However, it is difficult to place a biopsy nee- 
dle within a particular lymph node using this approach. 
The physician cannot see the lymph nodes, which He 
outside of the airway. Therefore, the physician can only 
position the endoscope tip and the biopsy needle at an 
approximate position, near the location of the lymph 
node to be biopsied. For this reason, there has been a 
significant need for improvement in the reliability of nee- 
dle aspiration biopsies of the lymph nodes surrounding 
the respiratory tract. There have been similar needs for 
improvement in other biopsies procedures using a 
probe advanced into the body, such as a biopsy needle 
or biopsy forceps to sample tissues in the vicinity of the 
respiratory tract. There have been similar needs for im- 
provement in other procedures where a probe is ad- 
vanced into the tissues of the thorax for other purposes 
as, for example, to perfomr) surgical procedures on 
these tissues or to administer drugs within these tissues. 
[0003] Some procedures heretofore have used imag- 
ing during advancement of the probe to provide guid- 
ance. Thus, as the probe is advanced, the probe and 
the body are imaged using conventional imaging tech- 
niques such as fluoroscopy or magnetic resonance im- 
aging. This allows the physician to observe the relation- 
ship between the position of the probe and the surround- 
ing tissues. These procedures have the disadvantage 
that the imaging apparatus is occupied for the entire 
time required to perform the procedure. Moreover, the 
use of fluoroscopic or other x-ray based imaging modal- 
ities during the procedure exposes the physician and the 
patient to radiation. 

[0004] As described, for example, in U.S. Patents 
5,558.091. 5,391,199; 5.443,489; and in PCT Interna- 
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tional Publication WO 96/05768, the position, orienta- 
tion or both of the distal end of a probe can be deter- 
mined by using one or more field transducers such as 
aHalleffectormagnetoresistive device, coil or other an- 
tenna carried on the probe, typically at or adjacent the 
distal end of the probe. One or more additional field 
transducers are disposed outside the body in an exter- 
nal frame of reference. The field transducers preferably 
are arranged to detect or transmit non-ionizing fields or 
field components such as a magnetic field, electromag- 
netic radiation or acoustical energy such as ultrasonic 
vibration. By transmitting the field between the external 
field transducers and the field transducers on the probe, 
characteristics of field transmission between these de- 
vices can be determined. The position and/or orientation 
of the sensor in the external frame of reference can then 
be deduced from these transmission characteristics. 
Because the field transducer of the probe allows deter- 
mination of the position of the probe, such transducer is 
also referred to as a "position sensor". 
[0005] As described, for example, in the aforemen- 
tioned U.S. Patent 5,558,091 , the frame of reference of 
the external field transducers can be registered with the 
frame of reference of imaging data such as magnetic 
resonance imaging data, computerized axial tomo- 
graphic data, or conventional x-ray image data. The 
probe position and orientation data derived by field 
transmission can be displayed as a representation of the 
probe superimposed on an image of the patient's body. 
The physician can use this infonnation to guide the 
probe to the desired location within the patient's body, 
and to monitor Its orientation during treatment or meas- 
urement of the body structure. This arrangement greatly 
enhances the ability of the physician to navigate the dis- 
tal end of the probe through bodily structures. Because 
it does not require acquisition of an optical image of the 
surrounding tissues for navigation purposes, It can be 
used with probes which are too small to accommodate 
optical elements, and can be used for navigation of the 
probe within solid or semisolid tissues. The transducer- 
based system also avoids the difficulties associated with 
navigation of a probe by continuous imaging of the 
probe and patient during the procedure. For example, it 
avoids exposure to ionizing radiation inherent in fluoro- 
scopic systems. 

[0006] Some additional problems are encountered in 
use of systems of this type for procedures in the thorax 
near the respiratory system. As the patient breathes, the 
positions, sizes and shapes of the thoracic organs 
change. Thus, if an image of the patient Is acquired at 
one stage of the respiratory cycle, the image data does 
not accurately represent the patient during other stages. 
Therefore, if the position of the probe is detected while 
the patient Is In one stage of the respiratory cycle, and 
this probe position data is combined with patient image 
data from another stage of the respiratory cycle to pro- 
vide an Image with a representation of the probe super- 
posed thereon, the location of the probe relative to the 
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surrounding organs will be depicted inaccurately. As de- 
scribed in International Publication WO 97/29709, prob- 
lems of this nature can be avoided by positioning a first 
probe, referred to as a "site probe" within the body of 
the patient at a location to be treated, and providing a s 
further probe, refenred to as an "Instrument probe" for 
perfonning the medical procedure. The site probe Is po- 
sitioned within the body at the location to be treated as, 
for example, at a location to be biopsied. Using a loca- 
tion system such as the magnetic location systenns dis- 
cussed in the aforementioned patents, the locations of 
both probes are monitored during the medical proce- 
dure. Therefore, the distance and direction from the in- 
strument probe to the site probe are known during the 
medical procedure, despite any motion caused by the 
patient's breathing. Using that directional and distance 
Infonmation, the physician can navigate the instrument 
probe to the site probe. 

[0007] PCT Publication WO 97/29682 refers to sys- 
tems for detemiining the "physiological motion" such as 
breathing motion or cardiac motion of a portion of the 
body in which a probe is situated. Using a device such 
as a belly strap to sense breathing motion, the system 
selects a "correct" image from a set of previously ob- 
tained images at each instant during the procedure, or 
interpolates between images. Thus, the displayed im- 
age always reflects the actual size and shape of the or- 
gans at the Instant in question. Accordingly, the repre- 
sentation of the probe can be accurately superposed on 
the display image. 

[0008] U.S. Patent 5,577,502 discloses a system in 
which the position of the subject's chest is monitored by 
devices such as optical, ultrasound or mechanical track- 
ing elements. Based on that positional tracking, the im- 
age used in a superposition system is distorted so as to 
provide a corrected image which changes as the subject 
breathes. The position of the probe can be superposed 
on the corrected Image. Systems of this type require 
considerable computation to distort the reference image 
as the patient moves through various stages of the res- 
piratory cycle. Moreover, additional equipment is re- 
quired for tracking the position of the patient's chest. In 
an alternative approach also discussed in the '502 pat- 
ent, a series of images is acquired at numerous stages 
of the respiratory cycle. As the patient moves through 
different stages of the respiratory cycle, different images 
are employed. This approach multiplies the task of ac- 
quiring and storing the Image data. Moreover, this ap- 
proach can only be used if a set of multiple Images ex- 
ists. For example, where the patient is subjected to a 
conventional diagnostic imaging procedure such as an 
MRl or GT imaging, a single set of image data repre- 
senting the patient at only one stage of the respiratory 
cycle generally is acquired. The need for a biopsy or oth- 
er procedure using a probe advanced into the patient 
may only be apparent after that image has been evalu- 
ated. To acquire a series of images, the patient must be 
subjected to further imaging procedures before the in- 



terventional procedure using the probe can begin. 
[0009] In US 5,482,042, there is disclosed a medical 
imaging apparatus including a respiration depth detect- 
ing device for detecting a respiration depth of a patient 
and an indication device for indicating the detected res- 
piration depth. The respiration depth detection device 
includes an ultrasonic measuring device for measuring 
a position of a surface of the body of the patient, a device 
for detecting the maximum and minimum extreme val- 
ues of position, and a device for calculating the respira- 
tion depth based on the maximum and minimum values. 
[001 0] Thus, despite these and other efforts in the art, 
further improvements in interventional procedures and 
apparatus for performing the same would be desirable. 

DISCLOSURE OF THE INVENTION 

[0011] According to the present invention, there is 
provided apparatus according to claim 1 . 
[0012] Thus, apparatus of the present Invention can 
utilise the same position measuring devices as em- 
ployed in determining the probe position to determine 
the respiratory cycle. 

[0013] Typically, the means for detecting is arranged 
to detect when the patient is in the selected state by de- 
termining whether the position of the reference point 
matches the extreme position within a preselected tol- 
erance. For example, the selected stage of the respira- 
tory cycle may be the minimum inspiration state, i.e. the 
state achieved at the end of exhalation during a normal 
breathing cycle. In this case, the system may select the 
position of the reference point at which the patient's front 
chest wall Is closest to the patient's back. If the patient 
is lying in a supine position, with his or her back on a 
table, the system may select the position where a refer- 
ence point on the patient's front chest wall is closest to 
the table. 

[0014] The probe can be advanced within an airway 

as, for example, to pass a part of the probe through the 
wall of the airway to treat tissue at a target location within 
the tissues surrounding the airway. An example of such 
a target location is the lymph nodes outside of the air- 
way. The probe may include an endoscope and a nee- 
dle. The endoscope can be advanced until the endo- 
scope is positioned at the wall of the airway adjacent the 
target location and then to advance the needle through 
the wall of the airway. 

[0015] The image may include a plurality of identifia- 
ble points on the body of the patient which have posi- 
tions substantially unaffected by the respiratory cycle of 
the patient. The identifiable points may, for example, In- 
clude a point on the scapula or on the sternum. 
[001 6] Typically, the computer is adapted to transform 
the disposition of the probe into the image frame of ref- 
erence. Desirably, the computer may be arranged to dis- 
play a perspective Image of the airway and surrounding 
tissues so that the position of the probe and the trajec- 
tory for moving the probe to engage the target location 
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can be visualized by viewing the displayed image. 
[0017] Because the disposition of tlie probe used as 
the basis for the superposed representation is acquired 
at the same stage in the respiratory cycle as the image, 
the motion artefact or inaccuracy caused by motion due s 
to the respiratory cycle is eliminated. The apparatus ac- 
cording to the invention thus provides a solution to the 
motion artefact problem which does not require acqui- 
sition of multiple imagesfor massive manipulation of im- 
age data to distort an image. The system is compatible 
with standard images acquired for diagnostic purposes 
which represent only one stage In the respiratory cycle. 
[0018] When in use, as the probe of the present in- 
vention is advanced the patient may be Instructed to 
hold his or her breath at the prescribed respiratory state. 
Thus, while the patient holds the prescribed point In the 
respiratory state, the system will continually acquire new 
positions of the probe and will continually update the su- 
perposed representation of the probe on the image. If 
the patient momentarily deviates from the prescribed 
stage of the respiratory cycle the system will stop gen- 
erating new superposed positions of the probe repre- 
sentation on the image and preferably will provide a 
warning to the physician. 

MODES FOR CARRYING OUT THE INVENTION 

[001 9] Apparatus according to one embodiment of the 
present invention includes a probe. The probe may in- 
corporate essentially any device which can be inserted 
or advanced into the body to perform a medical proce- 
dure, such as treatment, measurement or observation. 
As used herein, the tenm "treatment" Includes capturing 
samples of tissues or materials present within the body, 
and thus Includes biopsies. The probe desirably in- 
cludes a conventional endoscope having a tubular body. 
Body has a handle portion affixed to a proximal end of 
the body and has a distal portion remote from handle. 
Body has a bore extending longitudinally from its prox- 
imal end to its distal end and open to the outside through 
handle. Body may Incorporate a flexible section adja- 
cent the distal end, so that the distal end can be bent or 
pivoted relative to the remainder of the body. The endo- 
scope may incorporate devices for bending the distal 
end of the body so as to steer the device as it is ad- 
vanced into the patient's anatomy. The endoscope may 
further include a fiber optic or television system for vis- 
ually observing the anatomical features of the patient at 
the distal end of the endoscope. 
[0020] The probe further includes a conventional in- 
trabody medical tool such as a biopsy needle or other 
surgical tool operable from the proximal end or handle 
of the device. Merely by way of example, instead of a 
biopsy needle, the tool may be any conventional surgi- 
cal tool of the type commonly used In endoscopic, ar- 
throscopic, a laparoscopic surgical procedures; a biop- 
sy forceps or other sampling device; a needle, catheter 
or other drug delivery device; a measuring instrument 



such as athemnometer or electrical potential measuring 

electrode; a device for applying therapeutic radiation; or 
any other device which can be used to treat, measure 
or observe structures within the body of a living subject. 
Needle is arranged so that it can be advanced to an op- 
erative position outside of the distal end of body. Needle 
is arranged so that it can be manipulated and controlled 
from the proximal end or handle of the body. Thus, the 
needle is connected to a manipulating handle by con- 
ventional control elements or linkages. Other expedi- 
ents for manipulating and controlling a tool at the distal 
end of body can be employed as, for example, electrical, 
electronic or optical control linkages. Alternatively, a tool 
can be mounted in fixed position on body or formed In- 
tegrally therewith as, for example, where body is 
equipped with a cutting blade. 

[0021] A probe field transducer or position sensor is 
mounted in probe body adjacent the distal end thereof. 
Transducer may be a sensor arranged to detect mag- 
netic or electromagnetic fields. For example, the sensor 
may be a multiaxis, solid-state position sensor of the 
type disclosed in the aforementioned U.S. Patent 
5,558,091. Such a sensor incorporates a plurality of 
transducers sensitive to magnetic field components in 
mutually orthogonal directions. Other suitable position 
sensors include colls as disclosed in the aforemen- 
tioned U.S. Patent 5,391,199 and in PCT Application 
PCT/US95/01103, now published as PCT International 
Publication WO 96/05768,. 

[0022] Such coils may be provided as a single coil or 
as a plurality of orthogonal coils capable of detecting 
field components in orthogonal directions. Position sen- 
sor or field transducer is connected to leads which ex- 
tend through bore to and beyond the proximal end of 
body. 

[0023] The apparatus further includes a set of exter- 
nal field transducers or antennas defining a locating 
frame of reference. For example, external field trans- 
ducers may be mounted to a patient-supporting bed. An- 
tennas are linked to a field transmitting and receiving 
device and a computer which in turn is linked to a display 
device such as a cathode ray tube. The computer Is also 
provided with conventional Input devices such as a key- 
board, trackball, mouse and the like. Computer, field 
transmitting and receiving device and transducers are 
arranged to cooperate with the probe field transducer to 
detemnlne the dispositions of the field transducer on the 
probe, and hence determine the disposition of the distal 
end of the probe in the locating frame of reference of the 
external field transducers or antennas . These elements 
of the apparatus can be as described in the aforemen- 
tioned '091 or '199 patents. Other devices for detecting 
disposition of probes equipped with position sensors by 
transmission of non-ionizing fields are known in the art. 
As is known in the art, electromagnetic or magnetic 
fields can be transmitted between an antenna or field 
transducer mounted in an external frame of reference 
and a field transducer on a probe, and the disposition of 
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the probe can be calculated from the characteristics of 
the fields detected by the transducer on the probe. Thus, 
the external field transducers or antennas and the posi- 
tion sensor or probe field transducer on the probe coop- 
eratively define a plurality of transmitter-receiver pairs. 
Each such pair includes one transmitter and one receiv- 
er as elements of the pair. One element of each such 
pair is disposed on the probe and the other element of 
each such pair is disposed at a known disposition in the 
external frame of reference. Typically, at least one ele- 
ment of each transmitter-receiver pair is disposed at a 
different position or orientation than the corresponding 
element of the other pairs. By detecting the character- 
istics of field transmission between elements of the var- 
ious pairs, the system can deduce information concern- 
ing the disposition of the probe in the extemal frame of 
reference. The disposition infomnation can include the 
position of the probe, the orientation of the probe or both. 
Although the external field transducers are illustrated as 
mounted to a rigid structure such as a patient bed, so 
that the external field transducers remain in fixed posi- 
tion relative to one another, this is not essential. As de- 
scribed in commonly assigned PCT Publication WO 
97/29685, the external field transducers may be mova- 
ble relative to one another. The computer system can 
detennine the positions of the external field transducers 
by measuring the properties of fields transmitted be- 
tween these transducers, or between the external field 
transducers and calibration transducers mounted to the 
individual external field transducers. 
[0024] The apparatus further includes a reference 
field transducer mounted in a protective housing effec- 
tive to protect field transducer from physical damage 
when the field transducer is deployed at a position on 
the outside of a patient's body. Thus, the housing and 
field transducer can be mounted by any conventional 
expedient such as adhesive tape, bandages, sutures or 
the like at a selected point on the exterior of a patient. 
Optionally, housing may be provided with features such 
as flat pads or wings suture holes or other physical fea- 
tures which further facilitate attachment to the exterior 
surface of the body. Reference field transducer has es- 
sentially the same structure as probe field transducer 
discussed above. Leads connect the reference field 
transducer to the field transmitting and receiving device. 
The field transmitter and receiver and computer actuate 
external field transducers and reference field transducer 
to transmit and receive fields in the same manner as 
discussed above in connection with probe field trans- 
ducer. Thus, the system determines the disposition of 
the reference field transducer in the locating frame of 
reference defined by external field transducers. 
[0025] According to one embodiment of the invention, 
when In use, a patient P is imaged using any conven- 
tional imaging modality such as computerized tomo- 
graphic x-ray ("CAT" or "CT") imaging, magnetic reso- 
nance imaging or any other imaging method which is 
capable of depicting the intemal organs of the body and. 



particularly, the respiratory system and sun^ounding tis- 
sues. The image is acquired while the patient is at a se- 
lected respiratory state. The selected respiratory state 
is a stage of the patient's normal respiratory cycle. Pref- 
5 erably, the image is acquired while the patient Is at the 
so-called "minimum inhalation" stage. This stage is the 
stage during normal breathing where the patient has ex- 
haled the normal, tidal volume of air. The patient may 
be instructed to hold his or her breath at the selected 
10 state during image acquisition. The image may be a con- 
ventional diagnostic image acquired without regard to 
any special considerations for the therapeutic proce- 
dure and indeed acquired before the need for the ther- 
apeutic procedure is known. 
15 [0026] The image includes at least a portion of the pa- 
tient's thorax and includes certain features of the pa- 
tient's anatomy which are readily identifiable in the im- 
age with a good degree of precision. These include fea- 
tures of the skeletal system such as the scapula portions 
of the spine and the sternal notch . In the conventional 
manner, the image is provided as computer data defin- 
ing properties of structures of various locations within 
the body as, for example, x-ray absorption of individual 
volume elements or "voxels" in a CAT image or M Rl data 
defining magnetic resonance properties such as proton 
density, T^ or T2 for individual voxels. 
[0027] After the image has been acquired, the patient 
Is placed into position in the locating frame of reference 
defined by extemal field transducers as, for example, by 
placing the patient in supine position on the supporting 
table. Reference field transducer is then engaged suc- 
cessively with several of the aforementioned readily de- 
fined points on the patient's body as, for example, with 
each of the scapula, with the sternal notch or with readily 
identified points on the spine. This is done while the pa- 
tient remains in position on the table. The table may be 
provided with apertures or grooves in its surface to allow 
insertion of the reference field transducer into engage- 
ment with features of the patient's back. While the ref- 
erence field transducer Is in engagement with each de- 
fined point In the patient's anatomy, the external field 
transducers field transmitting and receiving apparatus 
and computer are actuated to detemriine the location of 
the reference field transducer In the locating frame of 
reference defined by the external field transducers. 
Thus, the locations of the various defined points in the 
locating frame of reference are provided to the compu- 
ter. 

[0028] An operator can also input the locations of the 
same defined points in the frame of reference of the im- 
age. For example, computer can be actuated to display 
depictions of the image which include the various iden- 
tifiable points in the anatomy and the operator can man- 
ually adjust a cursor on the image as, for example, by 
adjusting a knob, trackball or mouse incorporated in in- 
put devices. When the cursor is aligned with an identi- 
fiable point in all dimensions, the operator enters a fur- 
ther signal indicating to the computer that the coordi- 
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nates of the cursor In the image frame of reference cor- 
respond to the coordinates of the particular point in the 
anatomy. Once the coordinates of the identifiable points 
in the anatomy have been provided to the computer in 
the image frame of reference and in the locating frame 5 
of reference, the computer can derive a mathematical 
transfonnation between the locating frame of reference 
and the image frame of reference. Techniques for ac- 
quiring locations of points in the anatomy and deriving 
transformations between an image frame of reference 
and a locating frame of reference are well known and 
are described in the aforementioned patents and publi- 
cations. In a variant of such techniques, also described 
in these patents and publications, fiducial markers in- 
corporating field transducers are mounted on the patient 
before the imaging procedure, so that the fiducial mark- 
ers are visible In the image. The positions of the fiducial 
markers in the locating frame of reference are acquired 
by actuating the field transducers on the fiducial markers 
in conjunction with the external field transducers, in the 
same manner as described above. In other variants, the 
system acquires a succession of positions in the locat- 
ing frame of reference while a reference field transducer 
Is moved over a well-defined contour in the patient's 
anatomy. The computer system uses automatic pattern- 
matching techniques to find a feature having a contour 
including a set of locations in the image frame of refer- 
ence which can be mapped to the set of locations in the 
locating frame of reference by a rigid-body transforma- 
tion. Again, various techniques for finding matching 
points in both frames of reference, and for deriving a 
transformation between the locating and imaging 
frames of reference, are well known in the art. 
[0029] The reference field transducer is then mounted 
on a point on the outside of the patient's chest which 
moves during respiration. For example, the reference 
field transducer can be taped or sutured in place over 
one of the patient's ribs. While the patient remains in 
position on a table, the patient breathes normally and 
hence reference field transducer moves cyclically in a 
motion corresponding to the various phases of the res- 
piratory cycle. Thus, the location of reference field trans- 
ducer varies with time. The computer, in cooperation 
with the fleldtransmitting and receiving unit and external 
field transducers continually monitors the position of ref- 
erence field transducer. The computer tracks the posi- 
tion of the reference field transducer over time and gen- 
erates a plot of the reference field transducer position 
in a selected direction versus time. In practice, the plot 
consists of a series of numbers denoting the location of 
the reference transducer along the selected axis at var- 
ious times. The axis selected for tracking may be a ver- 
tical axis (towards and away from the table) and hence 
towards and away from the patient's back; a horizontal 
axis transverse to the longitudinal (head-to-toe) axis of 
the patient or an axis at an arbitrary angle between the 
vertical and the horizontal. 

[0030] The computer selects successive extreme po- 



sitions In the plot. For example, where the location rep- 
resented by the plot is location in a vertical axis corre- 
sponding to movement towards and away from the pa- 
tient's back, the computer may be actuated to select 
successive minima of such location, i.e., the points 
where the reference field transducer is closest to the pa- 
tient's back. Alternatively, where the location represent- 
ed by the plot is horizontal location, the computer may 
be actuated to select minima in the plot corresponding 
to locations where the reference field transducer is clos* 
est the central axis of the patient. These minima can be 
found by conventional computer-programming tech- 
niques for selecting local minimum values In a sequence 
of numbers. Numerical techniques of this nature are well 
known in the programming arts and are available in 
many standard mathematical software packages. The 
minima represent the minimum Inspiration point in the 
patient's respiratory cycle as discussed above. 
[0031 ] The value of the location at successive minima 
may not be exactly the same. However, for a patient 
breathing normally, all of the minima will have values 
close to one another. Thus, the computer calculates a 
mean value representing the mean location of several 
successive minima. The system then applies a prese- 
lected tolerance or maximum deviation. Whenever the 
location of reference field transducer deviates from the 
mean value by less than a predetennined tolerance the 
system treats the patient as being at the minimum inspi- 
ration point of the respiratory cycle. Thus, by monitoring 
the respiratory cycle, the system establishes a particular 
respiratory state corresponding to an extreme of the 
movement of the reference transducer encountered in 
normal respiration. 

[0032] In use, the physician advances the distal end 
of the probe into the respiratory system of the patient in 
the conventional manner. Typically, the distal end of the 
probe is advanced through an ainvay as, for example, 
through the larynx and trachea into the bronchi. Com- 
puter, field transmit and receive unit and external field 
transducers cooperate with probe field transducer to de- 
termine the position of the probe field transducer and 
hence the position of the probe distal end In the locating 
frame of reference defined by the external field trans- 
ducers, and cooperate with reference transducer to de- 
termine its position. When the position of the reference 
transducer is within the predetermined tolerance of the 
mean minimum inspiration location, the computer cap- 
tures the location of the probe field transducer and probe 
distal end in the locating frame of reference defined by 
the external field transducers. Thus, the computer cap- 
tures the location of the probe distal end when the pa- 
tient is at the minimum inspiratory state. 
[0033] The computer transforms the location of the 
probe distal end into the frame of reference of the image 
and prepares a composite display including at least a 
portion of the image and a representation of the probe 
superposed on the image. For example, the displayed 
image on cathode ray tube may include a depiction of 
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the portion of the airway together with a representation 

of the probe distal end. The Image also includes a de- 
piction of the target tissue, in this case a lesion outside 
of the airway but adjacent thereto. Preferably, the image 
displayed is a perspective view, so that the physician 
can readily perceive the spatial relationships between 
the distal end of the probe and the target tissue. The 
system may also generate a line or arrow on the dis- 
played Image showing the trajectory from the probe dis- 
tal tip to the target. The physician can use the informa- 
tion shown in the displayed Image to bring the probe dis- 
tal end into engagement with the target. For example, 
the physician can bring the distal end of the probe body 
into engagement with the airway adjacent the target and 
can advance the biopsy needle to its extended position 
and thus pierce the airway wall and engage the target. 
[0034] Because the location of the probe distal end is 
captured only when the patient is in the same respiratory 
state as used in Image acquisition, the acquired position 
of the probe distal end, transfomied into the frame of 
reference of the Image accurately represents the rela- 
tive position of the probe distal end and the surrounding 
tissues. The patient continues to breathe while the 
probe is advanced into the airway. A new probe position 
is acquired on each respiratory cycle when the patient 
reaches the minimum Inhalation state. Each time a new 
probe position is acquired, the display shown on CRT 
screen Is revised to conform with the new probe posi- 
tion. Thus, the physician can monitor the progress of the 
probe distal end towards the target tissue. The physician 
can accurately align the probe with the target tissue. 
[0035] The procedure discussed above can be varied 
in many ways. For example, the computer can be ad- 
justed to find the mean location for the maximum inha- 
lation of the patient's respiratory cycle, and the image 
may be acquired at a similar maximum Inhalation state. 
In a further variant, the computer can select an arbitrary 
axis for plotting motion of the reference transducer so 
that the axis is aligned with the principal direction of mo- 
tion of the reference field transducer during respiration. 
For example, the computer can first track the location of 
the reference field transducer using a horizontal, vertical 
or other preset axis to find maxima and minima in the 
location on that axis. The computer can then compute 
the average time between successive maxima or suc- 
cessive minima. That time corresponds to the period of 
the respiratory cycle. The computer can then test vari- 
ous pairs of locations, each including one point delayed 
In time by one full period from another point. The com- 
puter can then calculate the distance In three dimen- 
sional space between each pair of points. The pair of 
points which has the largest distance lie along the prin- 
cipal direction of movement of the reference field trans- 
ducer during the respiratory cycle. The computer can 
then plot location along this direction versus time. 
[0036] The Image may be acquired when the patient 
is at an abnomnal respiratory state such as a maximum 
forced exhalation obtained by deliberately forcing exha- 



lation with maximum voluntary effort, or a maximum 
forced inhalation obtained by deliberately forcing maxi- 
mum inhalation with a maximum voluntary effort. In this 
case, the state used during image acquisition will not 

5 recur during a normal respiratory cycle. Instead, the pa- 
tient is instructed to repeat the state while the system 
monitors the location of reference field transducer. After 
the patient repeats the state in one or more trials, the 
system records the location of the reference transducer 

10 at this state, or the mean location obtained in several 
trials. While the physician is advancing the probe into 
the respiratory system, the patient is instructed period- 
ically to repeat the same state. The system acquires the 
Image when the patient is holding his or her breath at 

15 the desired respiratory state. An arbitrary respiratory 
state such as a state midway between the maximum and 
minimum inhalation in a normal respiratory cycle can al- 
so be used. However, the patient typically will not be 
able to reproduce such an arbitrary state accurately. Ac- 

20 cording to a further embodiment of the invention, when 
In use, the system can provide guidance to the patient 
and the physician to aid in duplicating an arbitrary res- 
piratory state. Thus, if the reference transducer is 
mounted on the patient before the imaging procedure, 

25 and if the reference field transducer is visible In the im- 
age, the position of the field transducer relative to the 
Identifiable points on the body, such as the scapular 
spine or sternum will vary with the respiratory state of 
the patient. For example, If the reference field transduc- 

30 er is mounted to the ribs, the field transducer will move 
outwardly, away from the central axis of the body as the 
patient Inhales. When the patient is placed on table, in 
proximity to the extemal field transducers, the system 
can track the location of the reference field transducer 

35 In the manner discussed above. The position of the ref- 
erence field transducer can be transfonmed Into the 
frame of reference of the Image. If the patient Is in the 
same respiratory state as was used In Image capture, 
the position of the reference field transducer in the Im- 

40 age frame of reference will overiie the depiction of the 
reference field transducer In the image. In a further var- 
iant, two or more reference transducers may be at- 
tached to the patient at locations which move towards 
or away from one another during respiration. The sys- 

45 tem can track the distance between the reference trans- 
ducers as a measure of respiratory state. 
[0037] The physician can use the information as to the 
respiratory state provided by the reference transducer 
or transducers to provide feedback to the patient, as, for 

50 example, by Instructing the patient to Inhale or exhale 
slightly to better match the respiratory state used during 
image capture. Alternatively, a mechanical respirator 
can be controlled automatically to achieve superposition 
between the position of the reference field transducer 

55 as detemiined by the field transmitting and receiving ap- 
paratus and the position depicted in the image. Thus, 
the respirator may be arranged to provide substantially 
normal breathing followed by periods of forced breath 
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holding and inflation of the lungs to the extent necessary 
to match the position captured in the image. 
[0038] In the procedures discussed above, the probe 
is advanced through the airway. However, the same ad- 
vantages can be obtained in procedures where the 
probe is advanced through the skin or through the intes- 
tinal track to other organs affected by motion due to res- 
piration. 

[0039] As these and other variation and combinations 
of the features discussed above can be utilized without 
departing from the present invention, the foregoing de- 
scription of the preferred embodiment should be taken 
by way of illustration rather than by way of limitation of 
the invention defined by the claims. 

INDUSTRIAL APPLICABILITY 

[0040] The present invention can be applied in medi- 
cal and veterinary procedures. 



Claims 

1. Apparatus for performing a medical procedure on 
the respiratory cycle of a patient comprising: 

(a) means for acquiring an image of the patient 
in an image frame of reference while the patient 
is at a selected respiratory state, said selected 
respiratory state being a stage of the patient's 
normal respiratory cycle; 

(b) a probe adapted to be inserted into the res- 
piratory system of the patient, an intrabody 
medical tool, and a probe field transducer; 

(c) a set of external field transducers adapted 
to define a locating frame of reference, said 
transducers being linked to a field transmitting 
and receiving device and to a computer, where- 
in the computer, field transmitting and receiving 
device and external field transducers are ar- 
ranged to cooperate with the probe field trans- 
ducer to determine the disposition of the probe 
in the locating frame of reference; and 

(d) a reference field transducer which, when in 
use, is deployed on the outside of the patient's 
body at a position which moves during respira- 
tion and is connected to the field transmitting 
and receiving device, wherein the computer, 
field transmitting and receiving device and ex- 
temal field transducers are arranged to coop- 
erate with the reference field transducer to de- 
tennine its disposition in the locating frame of 
reference; 

wherein the computer is adapted to: 

transform at least one of the image and dispo- 
sition of the probe in said locating frame of ref- 



erence so as to place the image and the dispo- 
sition of the probe in a common frame of refer- 
ence; 

display said image of the patient with a repre- 
5 sentation of the probe superposed thereon at a 

location corresponding to the disposition of the 
probe in the common frame of reference; 
detect when the patient is in said selected res- 
piratory state by monitoring the position of the 
10 reference field transducer; 

establish a position of said reference field 
transducer corresponding to said selected 
stage of the respiratory cycle by monitoring the 
position of the reference field transducer over 
'5 a plurality of respiratory cycles and finding an 

extreme position of the reference field trans- 
ducer which recurs in each cycle. 

2. The apparatus of claim 1 , wherein said extreme po- 
20 sitlon corresponds to minimum inspiration. 

3. The apparatus of claim 2 or claim 3, wherein said 
computer is adapted to detect when the patient is 
in said selected stage by determining whether the 

25 position of the reference field transducer matches 
said extreme position within a preselected toler- 
ance. 

4. The apparatus of any preceding claim, wherein the 
30 probe is adapted to be advanced within an airway. 

5. The apparatus of claim 4, wherein the probe Is 
adapted to pass a part of the probe through the wall 

of the airway to sample or treat tissue at a target 
35 located within the tissues surrounding said airway. 

6. The apparatus of claim 5, wherein said probe in- 
cludes an endoscope and a needle and is adapted 
to advance the endoscope until the endoscope is 

40 positioned at the wall of the ainvay adjacent the tar- 
get location, and then to advance the needle 
through the wall of the ainway. 

7. The apparatus of any preceding claim, wherein said 
45 image includes a plurality of identifiable points on 

the body of the patient which have positions sub- 
stantially unaffected by the respiratory cycle of the 
patient. 

50 8. The apparatus of claim 7, wherein said identifiable 
points include a point on the scapula or on the ster- 
num. 

9. The apparatus of any preceding claim, wherein said 
55 computer is adapted to transfomi the disposition of 

the probe into the image frame of reference. 

10. The apparatus of claim 9, when dependent on claim 
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4, wherein the computer is arranged to display a 
perspective image of the airway and surrounding 
tissues so that the position of said probe and the 
trajectory for moving said probe to engage said tar- 
get location can be visualized by viewing the dis- 
played image. 



PatentansprQche 

1. Vorrichtung zum Ausfuhren eines medlzinlschen 
Vorgangs bei dem Atmungszyklus eines Patienten, 
welche folgendes umfaBt: 

(a) eine Einrichtung zum Erfassen eines Bildes 
des Patienten in einem Referenzbildrahmen, 
wahrend der Patient sich in eInem ausgewahl- 
ten Atmungszustand befindet, wobei der aus- 
gewahtte Atmungszustand ein Zustand des 
normalen Atmungszyklus des Patienten ist; 

(b) eine Sonde, die dafur eingerichtet Ist, in das 
Atmungssystem des Patienten eingefuhrt zu 
werden, eIn korperlntemes medizlnlsches Ge- 
rat und einen Sondenfeldwandler; 

(c) einen Satz externer Feldwandler, die dafiir 
eingerichtet sind, einen Referenzortsrahmen 
festzulegen, wobei die Wandler mit einer feld- 
aussendenden und empfangenden Einrichtung 
und mit einem Computer verbunden sind, wo- 
bei der Computer, die feldaussendende und 
empfangende Einrichtung und die externen 
Feldwandler dafiir eingerichtet sind, mit dem 
Sondenfeldwandler zusammenzuwirken, um 
die Verlagerung der Sonde in dem Referenz- 
ortsrahmen zu bestimmen, und 

(d) einen Referenzfeldwandler der, wenn er in 
Gebrauch ist, auf der AuBenseite des Korpers 
des Patienten an einer Position aufgebracht 
wird, die sich wahrend der Atmung bewegt, und 
der mit derfeldaussendenden und empfangen- 
den Einrichtung verbunden ist, wobei der Com- 
puter, die feldaussendende und empfangende 
Einrichtung und die externen Feldwandler da- 
fiir eingerichtet sind, mit dem Referenzfeld- 
wandler zusammenzuwirken, um die Verlage- 
rung in dem Referenzortsrahmen zu bestim- 
men; 



in dem gemeinsamen Referenzrahmen anzu- 
zelgen; zu bestimmen, wann sich der Patient In 
dem ausgewahlten Atmungszustand befindet, 
durch Ubenvachen der Position des Referenz- 

5 feldwandlers; und 

eine Position des Referenzfeldwandlers her- 
vorzubrlngen, die dem ausgewahlten Zustand 
des Atmungszyklus entspricht, durch Uberwa- 
chen der Position des Referenzfeldwandlers 

10 uber mehrere Atmungszyklen und durch Fin- 

den einer Extremposition des Referenzfeld- 
wandlers, die In jedem Zyklus wiederkehrt. 

2. Vorrichtung nach Anspruch 1 , bei dem die Extrem- 
15 position der minimalen Einatmung entspricht. 

3. Vorrichtung nach Anspruch 2 Oder 3, bei welcher 
der Computer dafiir eingerichtet Ist, zu ermittein, 
wann sich der Patient in dem ausgewahlten Zu- 

20 stand befindet, durch Bestimmen, ob die Position 
des Referenzfeldwandlers zu der Extremposition 
Innerhalb einer vorgegebenen Toleranz paBt. 

4. Vorrichtung nach einem der vorhergehenden An- 
25 spriiche, bei welcher die Sonde dafiir eingerichtet 

Ist, in einem Atemweg vorgeschoben zu werden. 

5. Vorrichtung nach Anspruch 4, bei der die Sonde da- 
fiir eingerichtet ist, einen Teil der Sonde durch die 

30 Wand des Atemwegs durchzufiihren, um Gewebe 
an einem Ziel zu priif en oder zu behandein, das sich 
in dem Gewebe befindet, das den Atemweg umgibt. 

6. Vorrichtung nach Anspnjch 5, bei der die Sonde ein 
35 Endoskop und eine Nadel umfaBt und die dafiir ein- 
gerichtet ist, das Endoskop vorzuschieben, bis das 
Endoskop an der Wand des Atemweges an dem 
Zlelort angrenzend angeordnet ist, und anschlie- 
Bend die Nadel durch die Wand des Atemweges 

40 vorzuschieben. 

7. Vorrichtung nach einem der vorhergehenden An- 
spriiche, bei der das Blld mehrere identiflzleri^are 
Punkte auf dem Korper des Patienten umfaBt, die 

45 Positionen aufwelsen, die von dem Atmungszyklus 
des Patienten im wesentlichen unbeelnfiuBt blei- 
ben. 



wobei der Computer dafiir eingerichtet ist: 

50 

wenigstens eines von dem Bild und der Veria- 
gerung der Sonde in dem Referenzortrahmen 
zu Qbertragen, um das Bild und die Veriagerung 
der Sonde in einem gemeinsamen Referenz- 
rahmen anzuordnen; 55 
das Bild des Patienten mit einer Darstellurig der 
Sonde, die darauf an einem Ort uberiagert ist, 
welcher der Veriagerung der Sonde entspricht, 



8. Vorrichtung nach Anspruch 7, bei dem die identifi- 
zierbaren Punkte einen Punkt auf dem Schulterblatt 
Oder dem Brustbein umfassen. 

9. Vorrichtung nach einem der vorhergehenden An- 
spriiche, bei dem der Computer dafiir eingerichtet 
ist, die Veriagerung der Sonde in den Referenzbild- 
rahmen zu Qbertragen. 

10. Vorrichtung nach Anspruch 9 mit Ruckbezug auf 
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Anspruch 4, bel welcher der Computer dafur elnge- 
richtet ist, ein perspektlvisches Bild des Atemweges 
und des umgebenden Gewebes anzuzeigen, so- 
da(3 die Position der Sonde und die Trajektorie zum 
Bewegen der Sonde, urn an dem Zielort anzuliegen, 
durch Betrachten des angezeigten Bildes visuali- 
siert werden kann. 



Revendications 



commun ; 

afficher ladite innage du patient avec une repre- 
i sentation de la sonde superposee a celle-ci en 

5 un endroit correspondant a la disposition de la 

sonde dans le cadre de r^f^rence comnnun ; 

detecter si !e patient se situe dans I edit etat res- 
piratoire selection n6 en controlant la position 
10 du transducteur de champ de reference ; 



1 . Appareil permettant d'effectuer une procedure me- 
dicale concernant le cycle respiratoire d'un patient, 
comprenant : 

15 

(a) un moyen pemiettant d'acqu§rir une image 
du patient dans un cadre de reference d'image 
pendant que le patient se situe k un 6tat respi- 
ratoire selection n6, lequel 6tat respiratoire se- 
lection n6 est un 6tat du cycle respiratoire nor- 20 
mal du patient ; 



etablir une position dudit transducteur de 
champ de r6f6rence correspondant au dit 6tat 
selection n6 du cycle respiratoire en controlant 
la position du transducteur de champ de refe- 
rence au cours de plusieurs cycles 
respiratoires ; et 

trouver une position extreme du transducteur 
de champ de r6f6rence qui revlent k chaque cy- 
cle. 



(b) une sonde congue pour §tre inser^e dans 
le systeme respiratoire du patient, un instru- 
ment medical intra-corporel et un transducteur 25 
de champ de la sonde ; 

(c) un ensemble de transducteurs de champ 
externes congus pour definir un cadre de loca- 
lisation de reference, lesquels transducteurs 30 
sont relies a un dispositif d'emission et de re- 
ception de champ ainsi qu'a un ordinateur, I'or- 
dinateur, le dispositif d'emission etde reception 

de champ ainsi que les transducteurs de 
champ externes 6tant disposes de maniere a 55 
cooperer avec le transducteur de champ de la 
sonde de manl^re k d^temniner la disposition 
de la sonde dans le cadre de localisation de 
reference ; et 

40 

(d) un transducteur de champ de reference qui, 
lors de Tutilisation, est d6ploy6 sur I'exterieur 
du corps du patient en une position qui se d6- 
place pendant la respiration, et qui est connec- 
ts au dispositif d'emission et de reception de 45 
champ, rordinateur, le dispositif d'emission et 

de reception de champ ainsi que les transduc- 
teurs de champ externes etant congus pour 
coopdrer avec le transducteur de champ de re- 
ference afin de determiner sa disposition dans so 
le cadre de localisation de reference ; 

appareil dans lequel I'ordinateur est congu pour : 

transformer r image et/ou la disposition de la ss 
sonde dans ledit cadre de localisation de refe- 
rence de maniere a placer I'image et la dispo- 
sition de la sonde dans un cadre de reference 



2. Appareil selon la revendication 1 , dans lequel ladite 
position extreme correspond a Tinspiration mlnima- 

te. 

3. Appareil selon la revendication 1 ou la revendica- 
tion 2, dans lequel ledit ordinateur est congu pour 
detecter le moment ou le patient se situe dans ledit 
etat selectionne en determinant si oui ou non la po- 
sition du transducteur de champ de reference cor- 
respond a ladite position extreme selon une tole- 
rance predetenminee. 

4. Appareil selon Tune quelconque des revendications 
precedentes, dans lequel la sonde est congue pour 
etre avancee dans une voie respiratoire. 

5. Appareil selon la revendication 4, dans lequel la 
sonde est congue pour qu'une partie de la sonde 
passe a travers la parol de la voie respiratoire de 
maniere a echantlilonner ou traitor des tissus au ni- 
veau d'une cible situee dans les tissus entourant 
lesdites voies respiratoires. 

6. Appareil selon la revendication 5, dans lequel ladite 
sonde comprend un endoscope et une aiguille, et 
est congue de maniere a faire avancer I'endoscope 
jusqu'^ ce que celui-ci soit positlonne au niveau de 
la parol de la voie respiratoire k proximite de i'em- 
placement cible, puis a faire avancer raiguille k tra- 
vers la paroi de la voie respiratoire. 

7. Appareil selon I'une quelconque des revendications 
precedentes, dans lequel ladite image comprend 
plusieurs points identifiables sur le corps du patient, 
dont les positions ne sont essentlellement pas af- 
fectees par le cycle respiratoire du patient. 
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8. Apparell selon la revendication 7. dans iequel tes 
points identifiablescomprennent un point sur I'omp- 
plate ou sur le sternum. 

9. Apparell selon I'une quelconque des revendlcatlons s 
pr^c^dentes, dans lequet leditordinateurestcon^u 
pour transfonner la disposition de ia sonde dans le 
cadre de reference de I'lmage. 

10. Apparell selon la revendication 9, lorsqu'elle de- io 
pend de la revendication 4, dans Iequel I'ordinateur 

est congu de mani^re k aff Icher une image en pers- 
pective de la vote resplratoire et des tissus environ- 
nants de sorte que la position de ladite sonde et la 
trajectoire de deplacement de ladite sonde pour is 
qu'elie entre en contact avec ledit emplacement a- 
ble, puissent etre visualisdes en regardant I'image 
afftch^e. 
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